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DEFECT INSPECTION METHOD 



BACKGROUND OF THE INVENTION 

The present invention relates to a defect 
inspection method, and in particular to a defect 
inspection method of semiconductor products that 
5 requires defect inspection of high precision. 

As the semiconductor design rule becomes 
SJ finer, the size of manufacturing defects of 

\| semiconductor products becomes extremely smalls For 

CS 

fU observation of semiconductor defects, scanning electron 

$ 

« 10 microscopes (hereafter referred to as SEMs) have begun 

PI 

|y to be used besides conventional optical microscopes. 

However, secondary electrons typically detected in SEMs 

ru 

have a problem that images with edges emphasized are 
often picked up and defects cannot be necessarily 

15 actualized favorably. 

Therefore, a technique of detecting reflected 
electrons together with secondary electrons are 
detected and detecting a defect by using both detected 
signals complementarily has begun to be applied. Since 

20 reflected electrons emitted from the inspection subject 
has a directivity, an output correlated with an 
inclination of a three-dimensional slope in a position 
of electron beam irradiation is obtained and it can 
also be utilized for obtaining a defect shape. 

25 It is known that the method utilizing 
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reflected electrons is effective in detecting defects* 
For example, in a technique disclosed in U.S. Patent 
No. 5,659,172, defects are extracted by detecting 
perspective images from a plurality of different 
5 directions in each of inspection positions and 

reference positions corresponding to the inspection 
positions, comparing perspective images detected from 
the same direction in an inspection position and a 
reference position, creating a plurality of comparison 
10 maps, and conducting computation on comparison maps. 

However, the conventional technique has a 
S9 problem that comparison maps created by comparing 

m 

* perspective views are susceptible to noise, and 

C3 

jry consequently minute defects cannot be detected stably. 

fU 

.q. 15 As the method for detecting perspective images, a 

Jrj technique of detecting only electrons emitted from a 

subject into a certain narrow angle direction by 
applying an electron beam to an imaging subject is 
typical . 

20 As compared with the case where the angle is 

not restricted, the electron detection intensity 
becomes small, and consequently the signal-to-noise 
ratio of the perspective views is aggravated. When 
comparing perspective images picked up in a defect 

25 position and a reference position at high 

magnification, local perturbation is usually applied in 
many cases in order to allow manufacturing tolerance of 
non-defective portions. It is now supposed that two 
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images, i.e., an image 1 and an image 2 are compared 
with each other in local perturbation. When an 
evaluation pixel in the image 1 is compared with a 
reference pixel in the image 2 corresponding thereto, a 
5 region corresponding to the manufacturing tolerance 
around the reference pixel in the image 2 is set. A 
difference between the evaluation pixel value and a 
pixel value that is closest to the evaluation pixel 
value among all pixels in the set region is outputted 
10 as a difference in the inspection pixel between the 
image 1 and the image 2 . 

This algorithm has a problem that when the 



m 

* signal -to -noise ratios of compared images are poor, a 



signal component of an obtained output image remarkably 
15 lowers. Because of this problem, there is a tendency 
to overlook minute defects in a high magnification 
state. 

SUMMARY OF THE INVENTION 

The problem of the conventional technique is 

20 solved by a defect inspection method including the 

steps of picking up images of a sample from a plurality 
of directions, thereby obtaining external appearance 
images of an inspection subject region of the sample 
picked up from the plurality of directions; picking up 

25 images of a comparison subject region designed so as to 
originally have an external appearance identical with 
that of the inspection subject region of the sample 



from a plurality of directions identical with those of 
the inspection subject region, thereby obtaining 
external appearance images of the comparison subject 
region picked up from the plurality of directions; 
5 correcting mis -registrations between the external 

appearance images of the inspection subject region of 
the sample picked up from the plurality of directions 
and the external appearance images of the comparison 
subject region picked up from the plurality of 

10 directions that respectively correspond to the external 
appearance images of the inspection subject region 
picked up from the plurality of directions; and 
detecting defects of the inspection subject region by 
using the external appearance images of the inspection 

15 subject region of the sample picked up from the 

plurality of directions and the external appearance 
images of the comparison subject region picked up from 
the plurality of directions corrected in mis- 
registration. 

20 Other objects, features and advantages of the 

invention will become apparent from the following 
description of the embodiments of the invention taken - 
in conjunction with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 
25 Fig. 1 is a basic configuration diagram of an 

embodiment according to the present invention. 

Fig. 2 is a diagram showing an image feature 
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in an embodiment according to the present invention. 

Fig* 3 is a diagram showing an embodiment of 
a defect extraction method according to the present 
invention* 

5 Fig. 4 is a diagram showing an image feature 

in an embodiment according to the present invention. 

Fig. 5 is a diagram showing a signal-to-noise 
ratio improving method in defect extraction processing 
according to the present invention. 
Q 10 Fig. 6 is a diagram showing an embodiment of 

jU a defect extraction method according to the present 

HI invention . 

fy 

1 ■ Fig. 7 is a diagram showing an embodiment of 
jjjjj an image comparison method according to the present 

2 15 invention. 



DESCRIPTION OF THE EMBODIMENTS 

The present invention will now be described 
by referring to Figs. 1 to 7. 

Fig. 1 is a block diagram showing a schematic 

20 general configuration of a semiconductor defect 

analysis system that is an embodiment of the present 
invention. Numeral 101 denotes an inspection subject. 
Numeral 100 denotes an image pickup unit, which 
includes basic components 102 to 108 described 

25 hereafter. Numeral 102 denotes an electron gun for 

applying electrons to the inspection subject 101 via an 
electron scanning unit 103. Numeral 104 denotes a non- 
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directional electron detection unit for detecting 
secondary electrons and reflected electrons generated 
from a sample by irradiation of electrons. Numerals 
105 and 106 denote narrow angle electron detection 
5 units for detecting secondary electrons and reflected 
electrons coming from a certain narrow angle direction 
range among secondary electrons and reflected electrons 
generated from the sample by irradiation of electrons. 

M» The narrow angle electron detection units 105 and 106 

Q 

P 10 are designed so as to be different in narrow angle 

03 

jU electron detection direction rage* The electron 

Sj 

ggj scanning unit 103 is controlled by a controller 107 so 

that two-dimensional scanning will be conducted with 
electrons emitted from the electron gun 102. Numeral 
15 108 denotes an image memory for storing outputs of the 
detection units 104, 105 and 106. Since two- 
dimensional scanning is conducted with electrons by the 
electron scanning unit 103 , defect images which differ 
in property according to the detection unit are stored 
20 in the image memory 108. 

The property of a narrow electron image will 
now be described by referring to Fig. 2. Numeral 201 
denotes a sectional shape of a defect that has stuck to 
the inspection subject. Numeral 202 denotes the 
25 electron gun. Numeral 203 denotes the electron 
scanning unit. Numeral 204 denotes the electron 
detection unit for detecting electrons from a narrow 
angle direction. The electron detection unit 204 



detects electrons reflected at the surface of the 
defect. When the defect surface is perpendicular to a 
line connecting the defect 201 and the electron 
detection unit 204, the electron detection unit 204 
obtains a strong signal. On the contrary , when the 
defect surface is in parallel to the line connecting 
the defect 201 and the electron detection unit 204 , the 
electron detection unit 204 obtains a weak signal. In 
the case where electrons are detected from opposed 
directions as represented by 105 and 106 shown in Fig. 
1, a slope detected brightly in an image detected by 
the detection unit 105 is detected darkly by the 
detection unit 106 , and on the contrary a slope 
detected darkly in an image detected by the detection 
unit 105 is detected brightly by the detection unit 
106. Numeral 205 in Fig. 2 denotes a shadow region of 
the defect 201. The region 205 is a region having no 
inclination, but the adjacent defect becomes an 
obstacle. Since electrons from the surface of the 
region 205 do not arrive at the electron scanning unit 
203 sufficiently, the region 205 is detected darkly. 

Owing to the property heretofore described, 
the inclination of the detection subject can be 
actualized by using a two-dimensional image formed from 
a signal obtained by the narrow angle electron 
detection units. Because of this property, images 
obtained from detection conducted by the narrow angle 
electron detection units 105 and 106 are hereafter 



referred to as perspective image 1 and perspective 
image 2, respectively. 

For conducting a review of semiconductor 
defects, it is necessary to extract defects. A 
technique for extracting defects most easily is pattern 
comparison. That is, it becomes possible to identify a 
region of a defect by comparing the defect with a 
semiconductor pattern of a non-defective article formed 
by the same design as that of the position of the 
defect. In order to implement this, a defect pattern 
containing a picked-up defect image and a reference 
pattern containing no defects are preserved in the 
image memory 108. Each of the defect pattern and the 
reference pattern is formed of the non-directional 
electron image, the perspective image 1 and the 
perspective image 2. Hereafter, sets each having three 
images are referred to as defect image set and 
reference image set. 

Numeral 109 denotes an image processing unit, 
which compares a defect image stored in the image 
memory 108 with a reference image to extract defects. 
The image memory 108 provided on the image pickup unit 
100 and image processing unit 109 may be connected to 
each other in a hardware manner or may be connected to 
each other via communication means such as a line. In 
the case where they are connected via communication 
means via a line, the image processing unit 109 can be 
installed at a distance from the image pickup unit 100 
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having the image memory 108. 

Fig. 3 shows defect extraction steps. First, 
three images obtained from the image pickup units 104, 
105 and 106 are mixed by computation (301 and 302) to 
5 generate one image. This computation is conducted for 
each of the defect image set and the reference image 
set. As a result, two mixed images are calculated. As 
for the perspective images 1 and 2, it is desirable to 
obtain a difference. The reason will now be described 
10 by referring to Fig. 4. Numeral 401 denotes an 
inspection subject. Numerals 402 and 403 denote 
electron detection units installed so as to be opposed 
to each other. Numeral 404 denotes a region that has 
become a shadow because the inspection subject 401 
15 itself becomes an obstacle when the detection unit 402 
detects electrons and electrons cannot be detected 
sufficiently. Numeral 405 denotes a region that has 
become a shadow for the same reason when the detection 
unit 403 detects electrons. The detection units 402 
20 and 403 detect electrons coming from opposite 

directions. This results in the following property. 
Typically, a region detected brightly by the detection 
unit 402 is detected darkly by the detection unit 403, 
and on the contrary, a region detected darkly by the 
25 detection unit 402 is detected brightly by the 

detection unit 403. When signals of the detection 
units 402 and 403 detected in the same position are 
represented by a two-dimensional vector, distribution 
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of this vector in different positions is subject to 
main component analysis. It will be appreciated that 
the main component becomes nearly the difference of 
signals of the regions 402 and 403 because of the 
above -described property. Therefore, it will be 
appreciated that it is effective to calculate the 
difference between the perspective image 1 and the 
perspective image 2 in order to reduce the loss of 
information when three images are combined into one 
image . 

One image is calculated from three images by 
calculating the difference between the perspective 
images and adding the non- directional electron image to 
the difference. By thus obtaining one image, it 
becomes possible to implement registration between the 
defect image set and the reference image set at a time. 
In the external view of the inspection subject, there 
are both portions that are easy to be picked up in a 
perspective image with high contrast and portions that 
are easy to be picked up in the non- directional image 
with high contrast. By combining high information 
content components of three images, which are different 
in property, into one image, it is possible to 
implement registration with higher precision as 
compared with the case where each image is registered 
singly. 

Subsequently, a mis -registration quantity 
between the obtained defect image set and the reference 
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image set is derived (303) . In order to correct the 
derived mis -registration quantity, image shifts of the 
reference image set (304 to 306) are conducted. 

In addition, in order to make equal in 
5 brightness corresponding images between the defect 

image set and the reference image set corrected in mis- 
registration, brightness corrections (307 to 309) are 
conducted. 

Successively, in each of the defect image set 

10 and the reference image set, a sum image and a 

difference image of the perspective image 1 and the 
perspective image 2 are calculated (310 to 313). 
Between the defect image set and the reference image 
set, difference images respectively of the sum image 

15 and the difference image are calculated by using local 
perturbation (314 to 316). Pre-dominance of deriving 
difference images and sum images once and thereafter 
calculating local perturbation difference images over 
direct calculating local perturbation difference images 

20 of the perspective view 1 and the perspective view 2 of 
the defect image set and the reference image set will 
now be described by referring to Fig. 5. The 
difficulty at the time when extracting defects by using 
perspective images lies in the fact that signal 

25 components are greater than noise components in 
perspective images. Since the perspective image 
detector detects only electrons coming from a narrow 
angle direction range, the signal-to-noise ratio tends 
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to fall as compared with the ordinary non- directional 
electron image. 

On the other hand, when defects at high 
magnification are detected, the pixel size tends to 
5 become small with respect to the manufacturing 

tolerance of the pattern to be inspected. Therefore, a 
necessity to calculate local perturbation difference 
image occurs. In the local perturbation difference 
image calculation, a section of a certain fixed region 

10 centering around an inspection pixel is set as a local 
perturbation region as shown in Fig. 5, a reference 
pixel that is closest in pixel value to the inspection 
pixel in this region is specified as a reference pixel 
corresponding to the inspection pixel. By thus 

15 deriving correspondence relations between the 

inspection image and the reference image every pixel 
and then subtracting corresponding pixel values, a 
difference image is generated. As the local 
perturbation region becomes wide in the local 

20 perturbation difference image calculation (314 to 316), 
the amplitude between the maximum value and the minimum 
value of noise in the region also becomes large. As a 
result, there occurs a problem that the difference 
image signal, i.e., AA - AB in Fig. 5 becomes small. 

25 This problem is improved by increasing the 

signal-to-noise ratio. Noise superposed on the 
perspective image 1 and the perspective image 2 can be 
considered to be white noise. In the case where the 
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perspective image 1 and the perspective image are 
subjected to addition or subtraction, the amplitude is 
expected to typically become 1 . 7 times . On the other 
hand, the amplitude of the signal components is nearly 
doubled by the subtraction as represented by a waveform 
406 of Fig. 4. On the contrary, the pixel value of the 
slope portion of the subject becomes nearly 0 (zero) as 
represented by 405. The influence of noise on the 
local perturbation difference appears generally as 
lowering of the signal strength. In the case where the 
inclination of the subject has become nearly 0 (zero) 
as a result of addition, demerits caused by lowering of 
the signal strength almost disappear. In the case 
where subtraction has been conducted, an increase of 
the signal strength is greater than that of noise, and 
consequently the signal-to-noise ratio is increased. 
As represented by the waveform 406 after subtraction, a 
region extracted in the case where the subtraction has 
been conducted includes both the defect portion and its 
shadow portion. 

What is needed as a defect is a region of the 
defect itself, and it is not the shadow portion of the 
defect. Therefore, it becomes necessary to subtract 
the shadow region from the waveform 406. This subject 
is implemented by subtracting the waveform 405 from the 
waveform 406. In the case where this processing is not 
conducted, the shadow of the defect is detected 
together with the defect. In the embodiment described 
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by referring to Fig. 3, the method of subtracting the 
waveform 405 from the waveform 406 has been described. 
In the case where only detection of an approximate 
position of the defect is necessary, it is also 
5 possible to omit this processing. As processing which 
needs only detection of an approximate position of the 
defect, for example, processing of picking up an image 
of a defect first at low magnification and calculating 
its approximate position as pre-processing with respect 

10 to processing of observing the defect at high 

magnification can be mentioned. This processing is 
frequently needed in Review SEMs . 

As for the defect and reference non- 
directional electron images as well, a difference image 

15 is calculated by using local perturbation. A resultant 
difference image 320 and a defect -reference difference 
image 321 obtained from the perspective images are 
added up. A resultant sum image is converted to binary 
values, and defects are extracted. The extracted 

20 defects are classified (322) into preset categories 
according to feature quantities of defects, and a 
result is displayed (323) on the screen. The 
classified defect information (324) is stored (325) in 
a server or the like via a communication line. By the 

25 way, higher defect extraction performance can be 

implemented by providing the non-directional defect - 
reference difference image 320 and the perspective 
defect -reference difference image 321 with appropriate 
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gains before carrying out addition computation. In 
some inspection subjects, irregular unevenness is 
present on the surface although the subject has no 
defects . 

In perspective images, even small unevenness 
generates a large signal when the inclination is large. 
In the inspection subject having unevenness, therefore, 
a problem of a false report that normal portions are 
extracted as defects is caused. By making the gain of 
the non- directional defect -reference difference image 
320 larger than the gain of the perspective defect - 
reference difference image 321 for such inspection 
subjects, it becomes possible to extract only defects 
without being affected by minute unevenness of non- 
defective portions. On the contrary, when minute 
unevenness as detected, such as micro -scratches often 
generated after the CMP process in the semiconductor 
manufacturing process, the gain of the perspective 
defect -reference difference image 321 is to be made 
larger than the gain of the non -directional defect - 
reference difference image 320. 

Although the scheme for extracting defects by 
utilizing two perspective images has been shown in Fig. 
3, it is also possible to detect defects more stably by 
utilizing more perspective images. For example, it is 
supposed that there are four perspective images and two 
perspective images detect electrons in each of mutually 
contradictory narrow angle direction ranges . In this 
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case, it is possible to consider that there are two 
corresponding sets each including two perspective 
images. Therefore, it is conceivable to calculate a 
signal corresponding to the perspective defect - 
reference difference image 321 of Fig. 3 from each of 
the sets and calculate a sum of resultant signals. 
Since noise components can be considered to be non- 
correlative in each set, it becomes possible to improve 
the signal-to-noise ratio by calculating the sum. 

As another method of favorably extracting 
defects by using perspective images without being 
affected by minute unevenness, three-dimensional shape 
comparison can be mentioned. As for a technique for 
calculating the three-dimensional shape of the 
inspection subject on the basis of perspective images, 
for example, the product of the sum image and the 
difference image of perspective images becomes the 
inclination. It is possible to derive the three- 
dimensional shape as integral of the inclination. 
Application of smoothing filtering on the image 
obtained as a product of the sum image and the 
difference image in a direction parallel to a straight 
line connecting two narrow angle electron detection 
units can be regarded as an approximate shape change in 
a section where convolution of the filter is conducted. 
A resultant image is referred to as shape image. A 
technique for extracting defects on the basis of a 
three-dimensional shape is shown in Fig. 6. 
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The configuration of Fig. 6 is same as the 
configuration of Fig. 3 as far as sum images (610 and 
612) and difference images (611 and 613) are calculated 
from perspective images 1 and 2 of a defect image set 
and perspective images 1 and 2 of a reference image 
set. However, an inclination of a defect is derived by 
calculating (614 and 615) the product of the difference 
image and the sum image. Typically, in the case where 
the signal-to-noise ratio of an image is poor, the 
image becomes less susceptible to an influence of 
inclination dispersion of the local subject and the 
extraction performance can be improved by lengthening a 
smoothing section. When the smoothing section is made 
too long, the image also tends to be more susceptible 
to an influence of an offset variation or the like of 
the image between the defect image set and the 
reference image set. By calculating (619) a difference 
image of images after being subjected to smoothing 
processing (615 and 617), height variations are 
compared between the defect image set and the reference 
image set. An absolute value thereof and an absolute 
value of a difference image (618) of the secondary 
electron image between the defect image set and the 
reference image set are added up. A resultant image 
(620) is converted to bi-values (621). As a result, it 
becomes possible to extract defects. 

By deriving a difference between shape images 
calculated respectively from the defect image set and 
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the reference image set, stable defect extraction that 
is not affected by minute unevenness can be 
implemented. As a matter of course, it is also 
possible to derive the difference image of the shape 
image and thereafter adding the difference image of the 
non- directional electron image. Information of the 
extracted defects is classified (622) into preset 
categories according to feature quantities of defects. 
A result of classification is displayed (623) on the 
display screen. In addition, the classified defect 
information (624) is stored (625) in a server via a 
communication line. 

Heretofore, the technique of generating a 
shape image from two perspective images has been 
described. It is also possible to form a shape image 
from more perspective images. For example, as a 
technique for forming a three-dimensional shape from 
four perspective images, the technique disclosed in JP- 
A-l-143127 can be applied. 

A technique for generating the difference 
image will now be described. In the case where the 
image of the inspection subject is picked up at such a 
magnification that the pixel size is greater than the 
size tolerance of the inspection subject as described 
above, it is necessary to derive an image difference by 
using local perturbation. This scheme has a problem 
that defects cannot be extracted in some cases such as 
the case where a pattern that is to be originally 
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present is not formed. An example thereof is shown in 
Fig. 7. In the defect image waveform of Fig. 7, a 
circuit pattern 701 that is to be originally present is 
not formed. The defect image waveform always has the 
same luminance value as a flat waveform 702. In the 
local perturbation, a pixel having luminance closest to 
the inspection pixel value in the local perturbation 
section is derived from the reference image, and the 
luminance difference is outputted as a difference image 
pixel value. 

In the example of Fig. 7, a pixel having the 
same pixel value as a defect pixel in a position where 
a circuit is not formed lies in the local perturbation 
section. Therefore, a defect that the circuit is not 
formed is overlooked. 

For solving this problem, each of local 
perturbation based on the defect and local perturbation 
based on the reference is to be conducted once and a 
greater output of them is to be outputted as a 
difference image value. 

In the embodiment of Fig. 1, the example in 
which irradiation and detection of the electron beam 
are conducted has been described. However, similar 
processing can also be implemented by using light. As 
a technique for deriving a three-dimensional 
inclination of the subject from light, there is a 
technique described, for example, in "Shape from 
Shading", Berthold Klaus Paul Horn: Robot Vision, MIT 
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Press, pp. 243-277. Without losing the generality, the 
technique described above can be applied intact ly. 

By applying the defect detection method 
heretofore described, subtraction and addition are 
conducted on perspective images each having a poor 
signal-to-noise ratio every two perspective images. 
Thus, images each having a high signal-to-noise ratio 
are generated. In addition, non-directional images 
each having a high signal-to-noise ratio are also 
added. As a result, stable defect detection can be 
implemented. 

The invention may be embodied in other 
specific forms without departing from the spirit or 
essential characteristics thereof. The present 
embodiment is therefore to be considered in all 
respects as illustrative and not restrictive, the scope 
of the invention being indicated by the appended claims 
rather than by the foregoing description and all 
changes which come within the meaning and range of 
equivalency of the claims are therefore intended to be 
embraced therein. 



